Skip to content

feat(casi): implement core IO and logging functionality #567

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: project/cas
Choose a base branch
from
Open

feat(casi): implement core IO and logging functionality #567

wants to merge 1 commit into from

Conversation

@jmt-lab
Copy link
Contributor

@jmt-lab jmt-lab commented Jul 30, 2025

Description of changes:
Introduces the base needed dependencies for casi and the io and logging setup.

Testing
cargo test -p casi

Terms of contribution:

By submitting this pull request, I agree that this contribution is dual-licensed under the terms of both the Apache License, version 2.0, and the MIT license.

@jmt-lab jmt-lab requested review from cbgbt and sam-berning July 30, 2025 22:21
@jmt-lab
Copy link
Contributor Author

jmt-lab commented Jul 30, 2025

Updated dep versions to remove duplicates

jmt-lab
jmt-lab commented Jul 30, 2025
View reviewed changes
Cargo.toml
update-metadata = { version = "0.1", path = "tools/update-metadata" }

anyhow = "1"
astral-tokio-tar = "0.5"
Copy link
Contributor Author

@jmt-lab jmt-lab Jul 30, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suspect you will be like O.O about this tokio tar and the async-compression crate below. The astral-tokio-tar is the currently maintaing tokio tar crate variant which provides us to use streaming tar readers for archives. async-compression likewise creates bufread and writer wrappers over zstd

@jmt-lab jmt-lab changed the base branch from develop to project/cas July 30, 2025 22:30
@jmt-lab
Copy link
Contributor Author

jmt-lab commented Jul 30, 2025

cargo fmt fix

@jmt-lab
feat(casi): implement core IO and logging functionality
a660f70 
- Add IO utilities for content hashing and stream processing
- Add logging system with progress tracking and verbosity control
- Define error types for the library
- Add constants for configuration parameters
@jmt-lab jmt-lab self-assigned this Aug 19, 2025
@jmt-lab
Copy link
Contributor Author

jmt-lab commented Aug 25, 2025

Example log from create command:

22:55:10.427 UTC INFO  Starting create operation for artifact: test 
    operation=create
22:55:10.429 UTC INFO  Successfully initialized CAS with local backend at: /Users/jmt/Projects/cassi/.cas
22:55:10.429 UTC INFO  Created artifact ID: [email protected]:abc 
    operation=create 
    [email protected]:abc
22:55:10.429 UTC INFO  create create started 
    operation=create 
    [email protected]:abc 
    session_id=93251ed3-5d41-43e5-a4d8-8a172f2bff7f 
    correlation_id=create-20f9da54
22:55:10.430 UTC INFO  push_manifest push_manifest started 
    operation=push_manifest 
    [email protected]:abc 
    backend=filesystem 
    session_id=93251ed3-5d41-43e5-a4d8-8a172f2bff7f 
    correlation_id=push_manifest-a8f422ab
22:55:10.431 UTC INFO  push_manifest push_manifest completed successfully 
    operation=push_manifest 
    [email protected]:abc 
    backend=filesystem 
    session_id=93251ed3-5d41-43e5-a4d8-8a172f2bff7f 
    correlation_id=push_manifest-a8f422ab 
    duration_ms=1 
    bytes_processed=133b 
    throughput_bps=115kb/s
22:55:10.431 UTC INFO  create create completed successfully 
    operation=create 
    [email protected]:abc 
    session_id=93251ed3-5d41-43e5-a4d8-8a172f2bff7f 
    correlation_id=create-20f9da54 
    duration_ms=1
22:55:10.431 UTC INFO  Successfully created artifact: [email protected]:abc 
    operation=create 
    [email protected]:abc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Sparksssj Sparksssj Sparksssj approved these changes

@cbgbt cbgbt Awaiting requested review from cbgbt

@sam-berning sam-berning Awaiting requested review from sam-berning

@qianxjcraig qianxjcraig Awaiting requested review from qianxjcraig

Assignees

@jmt-lab jmt-lab

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@jmt-lab @Sparksssj